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ABSTRACT 

This follow-up report to 'Individualized German 
Instruction at the College Level — A First Appraisal,* by Gerhard 
Clausing et al in "Foreign Language Annals, October 1972, employs a 
more rigorous analysis of pretest and posttest data than the first 
study and focuses specifically on test results involving the 
individualized and basic courses during the second quarter of the 
second year of the program. The evaluation of student achievement 
shows significantly better performance by individualized instruction 
students in reading nnd writing and equal oral performance compared 
with the basic course students. The findings confirm the conclusions 
of the first study and substantiate them with more rigorous 
statistical evidence. The data gathered over two years from a 
substantial student population are proposed as a demonstration of the 
basic soundness of individualized foreign language instruction. 
(Author/RS) 
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I. Introduction 



I 

m 



A description and first evaluation of the Individualized Instruction Pro- 
gram in German (hereafter referred to as I-I-) t Berkeley was presented after the 
program had been in operation for one /ear. That study' contains the description 

of the teaching materials and methods of instruction fo'* I- I-, and contrasts this 

2 

new course with the other courses offered by the departnient. These courses, to- 
gether with I. I., continue to be offered. In order to continue to measure the 
relative success of individualized instruction, this second evaluation was under- 
taken. 

The necessity for replication of research is evident- This seems especially 
important in the case of studies involving instructional innovation. The second 
study utilizes pretests used in much previous research- In addition, a greater 
number and variety of posttests were used and administered in a more systematic 
manner. The second study also employs a more differentiated and rigorous analysis 
of pretest and posttest data than the first study. As a consequence, the second 
study is in part a replication of, and in part different from, the first evalua- 
tion- It should also be noted that the data reported in both studies was gathered 
from a population of students who determined the course in which they would enroll, 



Gerhard Clausing, Klaus A. Mueller and Wilfried M. Voge, "Individualized Genman 
Instruction at the College Level— A First Appraisal," Foreign Language Annals , 
Vol. 6, No. 1, October 1972. 

^The Basic Course, the Intensive Course, and the Course Emphasizing Reading- 
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and that only thereaftsr sampling procedures were randomized. 

Since the course materials and instructional modes were described in de- 
tail in the first study, we vi 1 1 not repeat this information here. We shall fo- 
cus our report on the descriptions and results of the pretests and posttests which 
were employed during the second quarter of the second year of the program. Spe- 
cifically we shall deal with tests and test results involving the 1.1. and Basic 
Course (hereafter referred to as B.C.) students, since differences in course pro- 
cedures, materials and performance are perhaps of greatest interest in these two 
groups. 

In addition to the use of more suitable pretests and better controlled 
posttests we were able to match students in both courses more equally numerically 
than was possible in the first study. This resulted in our obtaining a substan- 
tially greater degree of confidence in the analysis of student achievement. 

I I . Test Measures and Data Analysis 

A. Pretests 

3 k 
The students oi the B-C and I. I. were given the MLAT and the Seashore 

tests during enrol l.nent and during the first day of classes- 

1 MLAT 

A t-test was computed for the MLAT pretest scores. The I. I. group sample 
was 137, the B.C. sample was 93- The t-value obtained was -7736, wh»ch is clearly 
not significant. Therefore we considered the two groups equivalent on the pretest 
scores of this measur for the purposes of our study. 



John B. Carroll and Stanley M. Sapon, Modern Language Aptitude Test, Form A 
(New York: The Psychological Corporation^ 1958) . 

Carl E. Seashore, Don Lewis and Joseph G. Saetveit, Seashore Measures of Musical 
Talents, Series. A (New York: The Psychological Corporation, 1939) • 
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2. Seashore 

As may be observed in the histograms of the Seashore test results presented 
below (Figures 1-6), the B.C. and 1.1. students were almost Identical and there 
were no significant deviations between the two groups. Because of this lack of 
significant differences of both groups we considered the two groups equivalent on 
this pre-test for the purposes of our study. 



Figure 1: Seashore—Pitch 
B.C. 
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Figure 2: Seashore — Loudness 
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Figure 6: Seashore — Tonal Memory 




Posttests 

For each comparison the pretest score MLAT and the posttest scores Lj, 
and (consisting of total number of minus points) were compared. denotes 

the average of U^, and U^, which are thirty-minute !.]. tests taken af t ir each 
respective unit in the first quarter of German stud/., Lj is the three-hour final 
B C test given regularly at the end of the first quarter of German- U^j is the 
average of U^, and Ug, thirty-minute I. I. tests taken after each respective 
unit in the second quarter of German study. L2 is the three-hour final B-C test 
given regularly at the end of the second quarter of German study. All of these 
tests were administered to randomly selected B.C* and 1 I . sample groups at ap- 
propriate times. 

It was deemed necessary to see whether the MLAT scores would have an effect 
on the posttest scores- For this purpose the regression lines were computed and 
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fitted into the graphs. For each student a dot was plotted, representing his pre- 
test score and his posttest score; then the regression 1 ine was fitted through the 
points estimating the ideal line which expresses the relation between the pretest 
score and the posttest score. This was done separately for the B.C. and I I . 
group in Level 1 (first quarter of German) and Level 2 (second quarter of Gennan). 

Then the F-test was applied. The F-test compares the spread in one popula- 
tion (l.|. students) against the spread in another population (B.C. students). 

A t-test was then done for each comparison. The t-test compares the dif- 
ference in means in populations relative to the spread within the populations- 

Compa r i son 1 : 

The two groups, l.i. and B*C*, were compared on the basis of their test 
scores in Lj. There were ^1 observations from B.C. and 13 observations from I.I. 

a. The ordinary t-test (without regard to pretest scores) yields a value 
of +2.66 which is significant at level .005 (one-sided test).. 

b. Taking into consideration the pretest score MLAT, we tried Id fit a re- 
gression line to the observed values of (MLAT, Lj) in the 1 . 1 . group, and the same 
in group B.C. This was done to explain some of the variation in the Lj scores by 
the variations in the MLAT-scores of the involved students- 

For each student a dot was plotted representing his MLAT and Lj score- The 
regression line v/as then computed and plotted. This was d(^ne separately for the 
B.C. and I . I v group. 

If the equation of the regression line is 

L, a oC + (MLAT - MLAT) 
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then "^-j^ represents the slope of the line, is the intercept of the line at 

■ •% 

MLAT = MLAT (MLAT is the average of MLAT-scores for the respective group under 
cons i deration) . . 



/\ Figure 7: Regr^sion line representation 
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"here a is negative 

The following values for and were computed as was s (the residual 
sum of squares divided by the degrees of freedom), which measures the variation of 
the data around the fitted line. 

B.C. 



A 



A 



23-38 
-.322 



s = 50.899 



'7^ - 36. kk 
= -396 
= 236. 718 



^denotes that a specific value is attached to the symbol. 

c The F-test for comparing the two variations around their respective re- 
gression lines shows a significant difference (at level .005), the F-value being 
^+.56 (degrees of freedom: 39 and 11 respectively). 



d. The t-test for equality of slopes gives a t-value of -35 (50 degrees 
of freedom), which is not significant. 

e. Considering the slopes equal for I.I. and B.C., one can test for dif- 
ferences in the X values and here the t-value is +2.77 (51 degrees of freedom), 
which is clearly significant at level .005- 
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LEVEL 1: Long Tests (Li)- B>C, 
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Figure 10 

LEVEL 1: Comparison I. I. vs. B.C. l 
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Summary (Figures 8-10) 

Whether taking the MLAT-scores into account or not, it can be said that the 
I- 1, students are significantly better than the B.C. students (see a. and eO- 

In our analysis it was found that the MLAT is a poor predictor. In com- 
paring t-test scores, with or without using the pretest score, they haa about the 
same values. 

There seems to be a greater variation among .he B.C. test scores , ) than 
among the I.I, scores. This might be due to better preparation on the part of 
the I.I. students (c ) . 

It can also be said that the rate at which the post-test scores change in 
•elation to the MLAT-scores is the same for both I.L and B.C. students, can 
be seer from the egual slopes ?n the regression line (d.). 

Comparison 2 : 

The two ^''o^PSt^'^l-^and B.C., ^ere compared on the basis of their average 

test score 0^ = — ^ !t . There were 36 observations of 0^ from B.C. and 

20 observations from I.I. 

a. The ordinary t-test (without regard to pre-test scores) yields a vaJue 
of ^-87, which is highly significant. 



b. Taking into consideration the pre-test score MLAT, we trieo to fit a 
regression line to the observed values of (MLAT, 0^.) in the LL group and the 
same in group B.C. This was done to explain some of the variation in the 0^ 
scores by the variations in the MLAT-sccres of the involved students. 

For each student a dot was plotted representing his MLAT and 0^ score. The 
regression line was then computed and plotted. This was done separately for the 
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B. C and I.I. groups- 

If the equation of the regression line is 

0^ = C:^ (MLAT-MLAT) 
N^'' represents the slope of the line, the intercept of the line at MLAT = 



MLAT (MLAT is the average of MLAT-scores for the respective group under considera- 
tion) . 

The following values for vVl and were computed, as was s (the residual 
sum of squares divided by the degrees of freedom), which measures the variation 
of the data around the fitted line. 

I.I. ^ B.C. 

A 4 



= 2.02 • ^ = 5. 18 

= -.0361 = -.0612 

= .9999 s^ =6-5 

c. The F-test for comparing the two variations around their respective re- 
gression lines shows a significant difference (at level .005), the F-value being 
3-25 (degrees of freedom: 3^ and 18 respectively). 

d. The t-test for equality of slopes gives a t-value of .8217, which is not 
significant. There is no compelling reason to believe that the two groups are 
different as far as the slopes of their regression lines are concerned. 

e. Considering the slopes equal for LI. and B.C., one can test the dif- 
ference of the value, and here the t-value is 5-07, which is highly significant. 



Figure 1 1 

LEVEL 1: short Tests (iL ) - B.C. 
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Figure 12 

LEVEL 1: Sh ort Tests rn.^ ^ - t t 
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Sumiiary (Figures 11-13) 

The significant difference between I.I, and B.C. seems to be even more pro- 
nounced in the scores than in the previous comparison (comparison I) on 
scores (see a. and e.)' 

There seems to be a much greater variation among the B.C. test scores (Uj) 
than among the I.I. scores. This might be due to better preparation on the part 
of the I.I. students (c. ) . 

Also, it can be said that the MLAT-score affects I.I. and B.C. students at 
the same rate, equal slopes in regression line (d.). 

Comparison 3 ' 

The two groups l.l. and B.C. were compared on the basis of their test scores 
in (three-hour test in the second quarter of German).. There were 38 observa- 
tions from B.C. and 15 from I- I. 

a. The ordinary t-test (without regard to pretest scores) yields a value 
of 2.72, which is significant at level -005 (one-sided). 

b. Taking into consideration the pretest score MLAT, we tried to fit a 
regression line to the observed values of (MLAT, L^) in the I.I. group and the 
same in group B.C. This was done to explain some of the variation in the L2 
scores by the variations ir the MLAT scores of the involved students. 

For each student a dot was plotted representing his MLAT and L2 scores.. The 
regression line was then computed and plotted. This was done separately for the 
B.C. and I.I. group. If we assume the equation of the regression line to be: 

L = V + (MLAT-MLAT) 
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represents the slope of the line, / the intercept of the line at MLAT = 



MLAT (MLAT is the average of MLAT-scores for the respective group under considera- 
tion). 

The following values for ./ and ^^/^ were computed, as was s (the residual 
sum of squares divided by the degrees of freedom), which measures the variation 
of the data around the fitted line. 

I.I. 



A 
\ 



27.46 
-.4130 



A, 



B.C. 



= 42.08 



1573 



s^ = 203.24 s^ ^ 335.35 

c Here the F-test for comparing the two variations around their respective 
regression lines shows no significant difference, the F-value being 1.65 (de- 
grees of freedom: 36 and 11). 

d. The t-test for equality of slopes gives a t-vdlue of .80 (49 degrees of 
freedom), which is not significant. 

There is no compelling reason to believe that the two groups are different 
as far as slopes are concerned. 

e. Considering the slopes equal for I.I. and B.C., one can test the dif- 
ference of the ^ value, and here the t-value is 2.19 (50 degrees of freedom), 
which is significant at level .05- 



I. 1.-18 



ERJC 



LEVEL 2: L ong Tests (hp 
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Figure I5 

LEVEL 2: L ong Tests (L^) - I.I. 
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Figure 16 



Summa ry (Figures 14-16) 

Whether the MLAT-scores are tak»3n into account or not, it can be said that 
the I.I, students are s i gn i i i can t ly better than the B.C. students (see a. and e. ) . 
It should be noted that the. t-value obtained in e. by taking into consideration 
the MLAT-scores is not as significant as the t-value in a. This may be due to 
the fact that the I.I. group on this level had subjects with generally higher 
MLAT-scores, so that sone of that difference between B.C. and I.I. can be at- 
tributed to the difference in MLAT-scores in these two groups. The variation 
in the B.C. and I.I. scores (L^) seem to be the sa^e (c). 

It can also be said that the MLAT-scores affect the I.I. and B.C. students 
at about the same rate, although in the graph there seems to be some optical dif- 
ference of slope in the two lines, which, however, is not statistically signifi- 
cant (d.). From the graph it may be seen that MLAT has little pred'iction value 
for L^, especially for the B.C. students. 

Comparison k : 

The two groups I.U and B.C. were compared on the basis of 0-.- = ^6 ^ ^/ ^ ^8 

^ 3 

their average test score in three thirty-minute tests at the end of each completed 
unit in Level 2, or during the second quarter of German. There were 30 observa- 
tions from B.C. and 10 from I.I. 

a. The ordinary t-test (without regard to pretest scores) yields a value 
of 5-10, which is highly significant, i.e., if the two groups are equal, then the 
chance of observing such a large t-value is very rare. 

b. Taking into consideration the pre-test score MLAT, we tried to fit a 
regression » ine to the observed values of (MLAT, O,.*) In the I.I. group and the 



same in group B.C. This was done to explain some of the variation in the 0^ ^ 
scores by the variations in the MLAT-scores of the involved students. For each 
student a dot was plotted representing his MLAT and U^^ scores. Then the re- 
gression line was computed and plotted. This was done separately for the B.C. 
and I.I. groups. If we assume the equation of the regression line to be: 

= * + (MLAT-MLAT) 
represents the slope of the line, the intercept of the line at MLAT = 

MLAT (MLAT is the average of MLAT-scores for the respective group under considera- 
tion). 

* The following values for ^ and ""^were computed, as was s (the residual 
sum of squares divided by the degrees of freedom), which measures the variation 
of the data around the fitted line. 

M> B.C. 
A A 
' • =3.5 = 9.22 

A ^ 

= -.0226 ^^ = .0086 

= 2. 318 = 12.071 

c The F-test comparing the two variations around their respective regres- 
sion lines yields an F-value of 5-2 (degrees of freedom: 28 and 8), which could 
be considered significant at level .01. 

d. The t-test for equality of slopes gives a t-value of .169, which is not 
s i gn i f i can t . 

e. Considering the slopes equal for I.I. and B.C., one can test the dif- 
ference of the .V value, and here the t-value is 4.75 (37 degrees of freedom), 
which is highly significant. 
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jummary (Figures 17-19) 

The significant difference between I. I. and B.C. seems to be more pro- 
nounced than in Comparison 3 (Figure 16). Comparisons 2 (Figure 10) and k 
(Figure 13) present similar evidence shovving that the difference in performance 
between the I. I. and B.C. groups is more pronounced on the short tests * This may, 
in part, be due to the fact that the I. I. student determines when he takes a unit 
examination, whereas the B.C. examination times are scheduled by the instructor. 
Furthermore the I.I. students prepare themselves by completing Practice Tests. 

The variation seems to be larger among the B.C. test scores (c). Although 
there seems to bean optical difference In slopes, this is not significant.: In 
the graph for the B.C. students, however, it seems to suggest that the MLAT-score 
is a poor predictor for the U^- scores. 

Comparison 5 ' 

It did not seem statistically worthwhile to investigate the third-quarter 
German students in the same way as above. The small sample of students (28) did 
not warrant a detailed investigation. We therefore computed the average of mis- 
takes for each posttest L^, U^j, U^^ and U^^. This was done separately for the 
I. I. and B.C. groups, and we compared them. Not considering the MLAT-scores for 
both I. I. and B.C., we can, however, conclude the following: 

The average number of minus points of the B.C. students on (the three- 
hour test given at the end of the thrrd quarter of German) is kk-87j whereas the 
average for the I. I. is 31-20. This cannot be considered significant in view of 
the small number of observations obtained (B.C. 23 observations, 1.1. 5 observa- 
tions) and because of the variation within the groups. 
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The analysis (not considering MLAT-scores) again verifies the phenomenon 
observed with the short tests Uj^ and U^, namely that I > I > students make fewer 
mistakes and are better prepared . The average minus points are given bel 



ow: 

Ujjt B.C. -8.05 M. -4.72 

^13: B.C. -10.05 -7-66 
U,^: B.C. -8.32 I.I. -3-27 

C. Evaluation of Oral Performance 

Since our initial appraisal of the oral performance of students in both 
tracks yielded inconclusive results, a detailed examination of oral work was con- 
ducted for this second appraisal. The same oral questions of various types were 
asked of both B.C. and I.I. students at appropriate times during the quarter, 
and tape recordings were made of the answers. From the total sample of several 
hundred taped oral performances, six questions were randomly selected (two for 
each level), and then B.C. and I.I. performances were randomly interspliced for 
each of the three levels, yielding a tape of kO performances, 15 each for Levels 
1 and Z and 10 for Level 3 . Fourteen judges (faculty members and teaching 
assistants who were not instructors of the students tested) were then asked to 
listen to the performances of all kO students and to evaluate them, giving each 
student a score along a scale from 10 to 0 (lO = outstanding, 5 = average, 0 = 
extremely poor) on each of four criteria: pronunciation, vocabulary, fluency, 
grammar. The results, summarized below, show that with one exception there was 
no significant difference between the I.I, and B.C. groups on any level on any 
of the criteria. We therefore conclude that the oral performance of I.I, students 
is as good as that of B.C. students . 
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Table 1: Oral Performance, Sample t-t ts, I.I. vs. B.C. 





N 


Pronunciat ion 


Vocabulary 


Fluency 


G ramma r 


Level 1 


I.I. =8 
B.C. = 7 


t = .k] 


t = .63 


t - 1.6 


t = .09 


Level 1 1 


I.I. =8 
B.C. = 7 


t - .OOi+7 


t = .6i+3 


t - .k]9 


t = .58 


Level III 


I.I. = k 
B.C. = 6 


t = .51 


t = .21 


t = .]k 


t = .16 



These t-values show no significant difference in each case, except that t = 1.6 
can be considered significant at the .1 level. 

III. Other Measures and Results 

A. Enrollment. When the course was first begun in the Fall (Quarter of 
1970, 37 students elected to be in the I.I. program. At that time 290 students 
were enrolled in the B.C. Since that time enrollments in the I.I. course have 
steadily increased, whereas enrollment In the B.C. has somewhat decreased (see 
Figure 20). Fluctuations in B.C. enrollment froni Fall to Spring of each 
year conform to the normal pattern at Berkeley. 

It may be noted that the total combined enrollment of B.C. and I.I. increased 
substantially due to the increased I.I. enrollment. 
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FIGURE 20! 
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B. Student- Instructor Ratios- It should be noted (Figure 21) that I.I. 
section size has increased from 9-8 to 35-7 students per instructor, that is, it 
has more than tripled, while B.C. section size increased by about 50% over the 
last two years- 
Figure 21: Average No- of Students per Instructor 
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The increase in student- i nstructor ratio for the B.C. is primarily due to 
the stringency of financial resources in the University. The additional increase 
in student- i nstructor ratio in the i.i. course is, however, primarily due to the 
fact that students, as was mentioned earlier, need to contact an instructor ap- | 
proximately only one-third as often as is necessary in the B.C. 

C. Achievement of Units. it may be noted from Figure 22 that the average 
number of units achieved by students in the I. I. program has decreased from k.S^ 
in the Fall of 1970 to 2.53 in the Spring of 1972. 



FIGURE 22: 
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The units achieved per quarter now seems to be leveling off and to amount 
to approximately half the units achieved fn the B.C. It was noted in B. above 
(Figure 21) that the ratio of students per instructor h the I. I. program inc^-eased 
rather dramatically. Not only is this due to the fact thjt students need to have 
contacts with instructors less often because of the instructional mode, but we now 
see from the results displayed in Figure 22 that it is also due to the fact that 
the average number of units being taken by I. I. students is only approximately 
half of the number of units taken by students in the regular course. Although 
the number of contacts an i.l. student has with the instructor, as mentioned ear- 
lier, is approximately one-third, the total time each instructor is scheduled to 
teach is approximately the same, since in this program many contacts are on a 
one-to-one basis- In our opinion this more personal contact of individual stu- 
dents with the instructor and the fact that students and instructors address 
themselves to the specific problems of each individual student account in part 
for the fact that achievement on the tests is generally higher for the I.l. stu- 
dents. 

D. Workload. An analysis of students' study lists, including courses 
other than I.l-, has shown that students are able to balance their programs in 
such a way that their quarterly workload in I.l. is well integrated with their 
other courses' As a general rule ft was observed that students who take a heavy 
load of I.l. units also have a higher total number of units on their quarterly 
program- 

E. Student and Instructor Q.uest ionnai res. As during the first year, we 
prepared student and instructor questionnaires- The questionnaires of the second 
year were similar to those of the first year- An analysis of the answers 



shows no significant differences from the responses obtained in the first year's 
study. Readers of this report who are interested in the results of the question- 
naire are asked to contact the authors. We feel that the inclusion of the ques- 
tionnaire results would unduly lengthen this paper, and we have therefore de- 
cided not to include them. 

IV. Conclusion 

The evaluation of student achievement in the second year shows significantly 
better performance by Individualized Instruction students in reading and writing 
and equal oral performance compared with the Basic Course students. These find- 
ings confirm the conclusions of our first study and substantiate them with more 
rigorous statistical evidence. The data gethered over two years from a substantial 
student population seems to demonstrate the basic soundness of individualized 
foreign language instruction. We recommend its use in a variety of instructional 
settings as wel 1 as its further refinement. 



